Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content

ABSTRACT

A method includes receiving a first three-dimensional video content, determining a three-dimensional format of the first three-dimensional video content, and converting a two-dimensional video content into a second three-dimensional video content based on the determined three-dimensional format, wherein converting the two-dimensional video content comprises decimating the two-dimensional video content. The method further includes splicing the second three-dimensional video content into the first three-dimensional video content.

CROSS-REFERENCE OF RELATED APPLICATIONS

This application is a continuation of U.S. Non-Provisional applicationSer. No. 13/042,064 filed on Mar. 7, 2011, which claims the benefit ofU.S. Provisional Patent Application No. 61/311,084 filed on Mar. 5,2010, both of which are incorporated by reference into this patentapplication in their entireties.

FIELD OF THE INVENTION

The present invention relates to three-dimensional and two-dimensionalvideo content and, in particular, to converting two-dimensional videocontent into three-dimensional video content and combining thethree-dimensional video content with the converted two-dimensional videocontent.

BACKGROUND

Depth perception for three-dimensional (3D) video content that can betransmitted as a part of 3D TV is provided by capturing two views, onefor the left eye and the other for the right eye. These two views arecompressed and sent over any of a number of different networks.Alternatively, the two views are stored on a storage medium. A decoderis used to decode the two views and sends the decoded 3D video contentfor display. Two categories exist to represent and format the two viewsthat are necessary to create the 3D video content. First are the halfresolution systems where the two views for the left eye and the righteye are merged together in as signal video frame. These half resolutionsinclude a horizontal 3D format (left and right views), a vertical 3Dformat (top and bottom views) and a quincunx 3D format (checkerboardviews). Second are views that are kept separate with full highdefinition (HD) resolution for both eyes.

3D video systems, and in particular 3D TV, faces a task of inserting 2Dvideo content into the 3D video content in such a way that permits easeof viewing the 3D and 2D video content. An example of the issue isbroadcasting a movie that is filmed and distributed using one of thehalf resolution 3D formats and inserting into the film a commercial orother type of content that is filmed and distributed using 2D format. If2D video content is inserted into the 3D video content without anythingmore, the 3D TV display has to recognize it and change its display modeto 2D. As most 3D display systems require a user to wear 3D glasses,there is also a need for the viewer of video content to take off theirglasses in order to view the commercial properly. This can put anunacceptable burden on the viewer as well as on the 3D TV. The 3D TVrepeatedly going back in forth to accommodate 3D and 2D video contentand the viewer repeatedly taking off and putting on 3D glasses iscounterproductive to the viewing pleasure of the 3D and 2D videocontent.

It is therefore needed to develop a way for the 3D TV to display the 3Dcontent and the 2D content in a manner that does not require the user toconstantly take off and put on the 3D glasses while enjoying the 3D and2D content.

BRIEF DESCRIPTION OF THE FIGURES

The accompanying figures, where like reference numerals refer toidentical or functionally similar elements throughout the separate viewsand which together with the detailed description below are incorporatedin and form part of the specification, serve to further illustratevarious embodiments and to explain various principles and advantages allin accordance with the present invention.

FIG. 1 illustrates network architecture in accordance with an embodimentof the invention.

FIG. 2 is a block diagram of 2D video content that is used in connectionwith some embodiments of the invention.

FIG. 3 is a block diagram that illustrates the format of one type of 3Dvideo content that is used in connection with some embodiments of theinvention.

FIG. 4 is a block diagram that illustrates the format of another type of3D video content that is used in connection with some embodiments of theinvention.

FIG. 5 is a block diagram that illustrates the format of yet anothertype of 3D video content that is used in connection with someembodiments of the invention.

FIGS. 6 a and 6 b are a block diagram of decimated 2D video content tobe converted into a 3D video content using one of the 3D video contentformats.

FIG. 7 is a block diagram of a system in which 2D video content isinserted into 3D video content in accordance with some embodiments ofthe invention.

FIG. 8 is a flow chart illustrating a method of inserting 2D videocontent into 3D video content in accordance with some embodiments of theinvention.

FIG. 9 is a block diagram of another system in which 2D video content isinserted into 3D video content in accordance with some embodiments ofthe invention.

FIG. 10 is a flow chart illustrating a method of inserting 2D videocontent into 3D video content in accordance with some embodiments of theinvention.

FIG. 11 is a block diagram of yet another system in which 2D videocontent is inserted into 3D video content in accordance with someembodiments of the invention.

FIG. 12 is a flow chart illustrating a method of inserting 2D videocontent into 3D video content in accordance with some embodiments of theinvention.

FIG. 13 is a block diagram of converting 3D video content from one 3Dvideo format into another 3D video format in accordance with someembodiments of the invention.

FIG. 14 is a flow chart illustrating a method of inserting 3D videocontent having one type of format into 3D video content that has adifferent format in accordance with some embodiments of the invention.

Skilled artisans will appreciate that elements in the figures areillustrated for simplicity and clarity and have not necessarily beendrawn to scale. For example, the dimensions of some of the elements inthe figures may be exaggerated relative to other elements to help toimprove understanding of embodiments of the present invention.

DETAILED DESCRIPTION

Before describing in detail embodiments that are in accordance with thepresent invention, it should be observed that the embodiments resideprimarily in combinations of method steps and apparatus componentsrelated to method and apparatus for converting two-dimensional videocontent into three-dimensional video content that to be inserted intothe three-dimensional video content. Accordingly, the apparatuscomponents and method steps have been represented where appropriate byconventional symbols in the drawings, showing only those specificdetails that are pertinent to understanding the embodiments of thepresent invention so as not to obscure the disclosure with details thatwill be readily apparent to those of ordinary skill in the art havingthe benefit of the description herein.

In this document, relational terms such as first and second, top andbottom, and the like may be used solely to distinguish one entity oraction from another entity or action without necessarily requiring orimplying any actual such relationship or order between such entities oractions. The terms “comprises,” “comprising,” or any other variationthereof, are intended to cover a non-exclusive inclusion, such that aprocess, method, article, or apparatus that comprises a list of elementsdoes not include only those elements but may include other elements notexpressly listed or inherent to such process, method, article, orapparatus. An element proceeded by “comprises . . . a” does not, withoutmore constraints, preclude the existence of additional identicalelements in the process, method, article, or apparatus that comprisesthe element.

It will be appreciated that embodiments of the invention describedherein may be comprised of one or more conventional processors andunique stored program instructions that control the one or moreprocessors to implement, in conjunction with certain non-processorcircuits, some, most, or all of the functions of convertingtwo-dimensional video content so that it can be inserted intothree-dimensional video content for 3D display described herein. Thenon-processor circuits may include, but are not limited to, a radioreceiver, a radio transmitter, signal drivers, clock circuits, powersource circuits, and user input devices. As such, these functions may beinterpreted as steps of a method to perform conversion oftwo-dimensional video content so that it can be displayed withthree-dimensional video content. Alternatively, some or all functionscould be implemented by a state machine that has no stored programinstructions, or in one or more application specific integrated circuits(ASICs), in which each function or some combinations of certain of thefunctions are implemented as custom logic. Of course, a combination ofthe two approaches could be used. Thus, methods and means for thesefunctions have been described herein. Further, it is expected that oneof ordinary skill, notwithstanding possibly significant effort and manydesign choices motivated by, for example, available time, currenttechnology, and economic considerations, when guided by the concepts andprinciples disclosed herein will be readily capable of generating suchsoftware instructions and programs and ICs with minimal experimentation.

In accordance with the principles described below, a method is disclosedthat converts video content from a first format type into a secondformat type so that the video content can be viewed with other videocontent that has the second video format type. The method includesdetermining a first format of a first stream of video content anddetermining a second format of a second stream of video content. Themethod also includes converting the format of the second stream of videocontent into the format of the first stream and combining the firststream of video content with the converted second stream of videocontent to form. In order to display the first and second video contentstreams the method decodes the combined first and converted secondstream of video content using the first format. As is understood, thefirst format is one of the 3D video formats and the second format is 2Dvideo format. In order to combine the video content, the method splicesthe first video content with converted second video content.

In another embodiment, the disclosed method includes providing 3D videocontent that uses a determined 3D video format and providing 2D videocontent. The method continues with converting the 2D video content into3D video content using the determined 3D video format. The converted 2Dvideo content is spliced into the 3D video content to create a combined3D video content. The combined 3D video content is then decoded anddisplayed.

In addition, an apparatus is disclosed that includes a transceiver thattransmits and receives 3D video content and 2D video content. Theapparatus includes a detector, a converter and a splicer. The detectoris used to determine the format type for 3D video content. Theconverter, which can include a decimator and a copier, converts the 2Dvideo content into the 3D video content using the determined formattype. The splicer combines the converted 2D video content with the 3Dvideo content to create a combined 3D video content that can bedisplayed on a 3D video device.

FIG. 1 illustrates a network architecture 100 in which a videoconversion device 130 may be used, according an embodiment. Embodimentsof the video conversion devices are described in more detail below. Asshown in FIG. 1, the network architecture 100 is illustrated as cabletelevision (CATV) network architecture 100, including a cable head-endunit 110 and a cable network 111. A number of data sources 101, 102,103, may be communicatively coupled to the cable head-end unit 110including, but in no way limited to, a plurality of servers 101, theInternet 102, radio signals, or television signals received via acontent provider 103. The cable head-end 110 is also communicativelycoupled to one or more subscribers 150 a-n through a cable network 111.

The conversion device 130 may be used in any network providing an MPEGstream to the STB 120. For instance, the video conversion device 130 maybe used in a network providing the 3D video content stream directly tothe STB 120. Alternately, the 3D video content stream may compriseInternet Protocol (IP) packets or any packetization scheme configured totransmit the 3D video content stream. The 3D video content stream may bereceived from a satellite transmission, the Internet or other network.As shown the video conversion device 130 is connected to the cablenetwork 111. In an embodiment shown with subscriber 150 d, the videoconversion device 130 can be connected to or be a part of the deviceslocated with the subscriber.

In an embodiment, the cable network 111 provides the 3D and 2D videocontent stream to each of the subscribers 150 a-n using, for instance,fixed optical fibers or coaxial cables. The 3D video content stream 139in this instance may be a QAM modulated stream. Each of the subscribers150 a-n may receive the 3D and 2D video content stream at an STB. Forinstance, the subscriber 150 n may receive the 3D and 2D video contentstream at an STB 120. The STB 120 may thereafter decode the 3D videocontent for display. Further, the cable network 111 is configured toprovide a plurality of programs multiplexed together in the subscriber150 n may use the STB 120 to select a program with 3D information. TheSTB 120 is a device that enables a television set to receive digitaltelevision (DTV) broadcasts.

The 3D video stream is a video stream carrying 3D and 2D video contentencoded in a format that a decoder is able to decode. The 3D videocontent may be comprised of multiple related views that required fordisplaying 3D video content. For instance, the 3D video stream may carry3D video content that may be decoded to form stereoscopic imagescomprised of a left eye view and a right eye view. The 3D video streamcan be formatted in any of known formatting techniques includingvertical, horizontal and quincunx formats. Alternately, themultiple-view stream may carry information that may be decoded to formmore than two views. The 3D video stream may also include multiplesub-streams and information related to the depth of the objects in thescene. The subscriber 150 n may have a 3D-ready TV 122 capable ofdisplaying 3D stereoscopic views. The STB 120 may include a decoder.

Turning to FIGS. 2-5, different types of video formats are shown. FIG. 2is a basic block diagram of video content 200 that is displayed intwo-dimensions (2D). The image 202 is configured to be displayed on amonitor such as a 2D TV monitor in a known manner on both the x-axis andthe y-axis. FIGS. 3-5 illustrate three different types of video contents300, 400, 500 that use different formats to display video content inthree-dimensions (3D) and in a known manner in the x-axis, y-axis andz-axis. FIGS. 3-5 illustrate the video content 300, 400, 500 in terms ofthe content that is intended for the left eye and the right eye of aviewer.

FIG. 3 illustrates 3D video content 300 that use vertical format,otherwise referred to as top and bottom format where an image 301 isconfigured to be displayed on a 3D monitor such as a 3D TV. Forinstance, the left eye view may comprise a left eye top panel 302 andthe right eye view a right eye bottom panel 304 of a same video frame.Currently many commercially available 3D TVs are operable to take videoformatted in this format for display in 3D.

According to another embodiment in FIG. 4, the basic stream of the videocontent 400 is formatted in horizontal dimension, otherwise referred toas a side-by-side left and right view (for instance, half vertical panelfor each view) format. The image 401 is configured to be displayed on a3D monitor. In the side-by-side left and right view format, the leftview forms a left side panel 402 and the right eye view forms a rightside panel 404 of each video frame. Currently some commerciallyavailable 3D TVs are operable to accept video content formatted in thisformat for display.

According to another embodiment, the basic stream of the video content500 is formatted using in a checkerboard pattern format, known asquincunx, of left and right 3D views, as shown in FIG. 5. Thecheckerboard pattern format may be generated by quincunx sampling usinga diamond filter for a left eye panel and a right eye panel. The diamondfilter samples the left eye panel and similarly the right eye panel toform a sampled left eye panel 502 and a sampled right eye panel 504. Thesampled panels are intermixed in a combined image in the checkerboardpattern. The checkerboard pattern format is spatial sequential.Currently many commercially available 3D TVs are operable to take videointermixed in this format, separate the 3D views and display in a 3Dformat.

FIGS. 6 a and 6 b illustrate 2D video content 600, shown in FIG. 6 a,that is converted into the vertical or top and bottom format shown inFIG. 3. The left eye view 602 is created from the 2D video content andis decimated vertically and inserted on the top half of the video frame604 of a 3D video stream. The left eye view can be copied andappropriately shifted to the right eye view. In another embodiment, theright eye view 606 is also decimated vertically and inserted in thebottom half of the video frame 604 of the 3D video stream. Similarly,the 2D video content can be decimated to form horizontal orquincunx-type video frames for the 3D video stream. The methods andapparatuses to do that are described in more detail below.

As is understood from FIGS. 6 a and 6 b, the video frame 604, 608 willconsist of two views 602, 606 that are formed in accordance with one ofthe 3D video formats described. The two views can be compressed using,for example MPEG-4 AVC/H.264 and set to a receiver, such a set top box(STB) or 3D TV. The STB or 3D TV receives and decodes the video,decomposes it in two views, interpolates each to full resolution anddisplays them. In an embodiment, a commercial that is provided in 2Dvideo format can be inserted into a 3D video stream by decimating the 2Dvideo stream vertically, horizontally or quincunxly into two halves ofthe same video frame before splicing the converted 2D video stream intothe 3D video stream.

FIG. 7 is a block diagram of a video conversion device 700 thatcorresponds to video conversion device 130 and that is used to convert2D video content to be inserted into 3D video content. As understood,the video conversion device 700 can be a part of the cable head end 110.In another embodiment the video conversion device 700 can be a part ofthe subscriber 105 a-n. In the embodiment shown, a compressed 3D videostream 702 is provided. The 3D video stream can be any of the describedvertical format, horizontal format or quincunx format. Regardless of theformat that is used, the format is known to the video conversion device700. Two-dimensional video content is also provided. The 2D videocontent can be either uncompressed 2D video content 704 or compressed 2Dvideo content 706. The 3D video content 702 and the 2D video content704, 706 are received by the device 700 by a transceiver. A 2D videodecoder 708 is provided that will decode the compressed 2D video content706 so that decompressed video content 710 is outputted. Thedecompressed 2D video content 710 and the uncompressed 2D video content704 are input into a 2D video content decimator 712. The 2D videocontent decimator takes the inputted 2D video content and formats thesize or bandwidth of the 2D video content so that the 2D video contentcan be converted into the 3D video content format known by the device700 that is provided by 3D audio/video bit stream 702. The decimatedvideo content is input into a video content copier 714 that takes thereformatted size video content and repeats and offsets so that thecopier 714 converts the decimated 2D video content from sources 704 and706 into a 3D video format. The decimator 712 and the copier 714 arecollectively known as a converter. The format of converted 2D videocontent 716 output from the copier 714 is in one of the vertical,horizontal or quincunx format that corresponds to the format of thecompressed 3D video content 702. The converted 2D video content 716 isinput into a compressor 718 so that it is compressed similar tocompressed 3D video content 702.

A bit stream splicer 720 is provided. The compressed 3D video content702 and the compressed converted 2D video content are input into thesplicer 720. The splicer combines the two inputs into a combined 3Dvideo content 722 that is provided from the cable head end 110 to eachof the subscribers 150 a-n. The splicer inserts the converted 2D videocontent into selected or designated locations within the 3D videocontent stream. Each of the subscribers that have the 3D ready TV 122can decode the combined 3D video content and display that content in 3Dto an end user.

FIG. 8 is a flow diagram that illustrates the method that is performedby the video conversion device 700 described in FIG. 7 and that combinesa 2D video content stream with a 3D video content stream so that the twovideo content streams can be displayed on a 3D display device such as 3DTV. The method begins by providing 802 a compressed 3D video content.The compressed 3D video content can be a 3D TV audio/video bit streamthat is configured in one of a number of known formats, e.g. verticalformat, horizontal format or quincunx format. In an embodiment, the 3DTV audio/video bit stream is TV programming that has been created using3D technology. The method also includes providing 804 2D video content.The 2D video content is conventional programming and can include a 2Daudio/video bit stream such as a commercial that will be inserted intothe 3D audio/video bit stream. The 2D video content that is to be usedby the video conversion device 700 can be either uncompressed 2D videocontent 704 or compressed 2D video content 706. In the case of thecompressed 2D video content 706, the video decoder decompresses thecontent.

The 2D video content 704, 706 is provided to the decimator 712. Themethod continues by decimating 806 the 2D video content 704, 706 as apart of the process of converting the 2D video content into a formatthat can be displayed by 3D device such as a 3D TV. The decimated 2Dvideo content is input into the video content copier 714. The decimated2D video content is then copied 808. The combination of decimating 806and copying 808 takes the 2D video content and formats the content intoa vertical, horizontal or quincunx pattern for one of the left eye orthe right eye and then repeated into the other vertical, horizontal orquincunx pattern for the other of the left or right eye. The 3D formatchosen to create the converted 2D video content 716 is the known 3Dformat for the compressed 3D video content 702. Thus, the decimating andcopying creates converted 2D video content 716 where the converted 2Dvideo content is in a format that can be displayed with the 3D videocontent 702 by a 3D device such as a 3D TV.

The converted 2D video content 716 is compressed 810 by compressor sothat the converted 2D video content is compressed in the same format asthe compressed 3D video content. The compressed 3D video content 702 andthe converted 2D video content are input into the bit stream splicer720. The method 800 continues by splicing 812 the 3D video content 702and the converted 2D video content 716 together to form combined 3Dvideo content 722. The combined 3D video content is output 814 so thatit can be displayed by a 3D device. In an embodiment, the 2D videocontent 704, 706 is a commercial that will be inserted into a 3D TVprogramming, e.g. 3D movie to be displayed on a 3D TV. The converted 2Dvideo content 716 is spliced into the 3D video content at designatedpoints within the video steam so that the combined 3D video can beoutput and easily displayed by the 3D TV.

FIG. 9 is a block diagram of another video conversion device 900 thatcorresponds to video conversion device 130. As understood, the videoconversion device 900 can be a part of the cable head end 110 or thesubscriber end 150 a-n. In the embodiment shown, an uncompressed 3Dvideo stream 902 is provided. The 3D video stream 902 can be any of thedescribed vertical, horizontal or quincunx 3D formats. Regardless of theformat that is used, the format is known to conversion device 900.Two-dimensional video content is also provided. The 2D video content canbe either uncompressed 2D video content 904 or compressed 2D videocontent 906. The 3D video content 902 and the 2D video content 904, 906are received by the device 900 by a transceiver. A 2D video decoder 908is provided that will decode the compressed 2D video content 906 so thatdecompressed video content 910 is outputted. The decompressed 2D videocontent 910 and the uncompressed 2D video content 904 are input into a2D video content decimator 912. The 2D video content decimator 912 takesthe inputted 2D video content and formats the size or bandwidth of the2D video content so that the 2D video content can be converted into theknown type of 3D video content provided by 3D audio/video bit stream902. The decimated video content is input into a video content copier914 that takes the reformatted size video content and repeats so thatthe copier 914 converts the 2D video content 904, 906 into 3D videocontent. The format converted 2D video content 916 output from thecopier 914 is in one of the vertical, horizontal or quincunx format thatcorresponds to the format of the 3D video content 902. The decimator 912and the copier 914 are collectively known as a converter.

A bit stream splicer 918 is provided. The uncompressed 3D video content902 and the converted 2D video content 916 are input into the splicer918. The splicer combines the two inputs into a combined 3D videocontent 920. The combined 3D video content 920 is provided to theencoder 922 to create the combined 3D video content that is providedfrom the cable head end 110 to each of the subscribers 150 a-n. Thesplicer insets the converted 2D video content into selected ordesignated locations within the 3D video content stream. Each of thesubscribers that have the 3D ready TV 122 can decode the combined videocontent and display that content in 3D to an end user.

FIG. 10 is a flow diagram that illustrates the method that is performedby the video conversion device 900 described in FIG. 9 and that combinesa 2D video content stream with a 3D video content stream so that the twovideo content streams can be displayed on a 3D display device such as3DTV. The method begins by providing 1002 uncompressed 3D video content.The compressed 3D video content can be a 3D TV audio/video bit streamthat is configured in one of a number of known formats, e.g. verticalformat, horizontal format or quincunx format. In an embodiment, the 3DTV audio/video bit stream is TV programming that has been created using3D technology. The method also includes providing 1004 2D video content.The 2D video content is conventional programming and can include a 2Daudio/video bit stream such as a commercial that will be inserted intothe 3D audio/video bit stream. The 2D video content that is to be usedby the video conversion device 900 can be either uncompressed 2D videocontent 904 or compressed 2D video content 906. In the case of thecompressed 2D video content 906, the video decoder decompresses thecontent.

The 2D video content 904, 906 is provided to the decimator 912. Themethod continues by decimating 1006 the 2D video content 904, 906 as apart of the process of converting the 2D video content into a formatthat can be displayed by 3D device such as a 3D TV. The decimated 2Dvideo content is input into the video content copier 914. The decimated2D video content is then copied 1008. The combination of decimating 1006and copying 1008 takes the 2D video content and formats the content intoa vertical, horizontal or quincunx pattern for one of the left eye orthe right eye and then repeated into the other vertical, horizontal orquincunx pattern for the other of the left or right eye. The 3D formatchosen to create the converted 2D video content 916 is the known 3Dformat for the uncompressed 3D video content 902. Thus, the decimatingand copying creates converted 2D video content 916 where the converted2D video content is in a format that can be displayed with the 3D videocontent 902 by a 3D device such as a 3D TV.

The 3D video content 902 and the converted 2D video content 916 areinput into the bit stream splicer 918. The method 1000 continues bysplicing 1010 the 3D video content 902 and the converted 2D videocontent 916 together to form combined 3D video content 920. The combined3D video content 920 is then encoded 1012 by encoder 922 and is output1014 so that it can be displayed by a 3D device. In an embodiment, the2D video content 904, 906 is a commercial that will be inserted into a3D TV programming, e.g. 3D movie, to be displayed on a 3D TV. Theconverted 2D video content 916 is spliced into the 3D video content atdesignated points within the video steam so that the combined 3D videocan be output and easily displayed by the 3D TV.

FIG. 11 is a block diagram of a video conversion device 1100 thatcorresponds to vide conversion device 1300. As understood, the videoconversion device 1100 can be a part of the cable head end 110 orcollocated with a subscriber 150 a-n. In the embodiment shown, acompressed 3D video stream 1102 is provided. The 3D video stream 1102can be any of the described vertical format, horizontal format orquincunx format. Two-dimensional video content is also provided. The 2Dvideo content can be either uncompressed 2D video content 1104 orcompressed 2D video content 1106. The 3D video content 1102 and the 2Dvideo content 1104, 1106 are received by the device 1100 by atransceiver. A 2D video decoder 1108 is provided that will decode thecompressed 2D video content 706 so that decompressed video content 1110is outputted.

The decompressed 2D video content 1110 and the uncompressed 2D videocontent 1104 are input into a 2D video content decimator 1112. The 2Dvideo content decimator takes the inputted 2D video content and formatsthe size or bandwidth of the 2D video content so that the 2D videocontent can be converted into the type of 3D video content provided by3D audio/video bit stream 1102. To determine the format that the 2Dvideo content is to be converted to, the device 1100 includes a detector1114. The detector 1114 parses the 3D video bit stream and determines ifthe bit stream is formatted as vertical 3D format, horizontal 3D formator quincunx 3D format. In an embodiment, the detector parses the syntaxof the 3D video content stream to look for the SEI message standardizedby MPEG-4 AVC/H.264, or any other private signaling used to signal theformat. The result of the detector 1114 is input to the decimator 1112so that the decimator 1112 will convert the 2D video content in theappropriate manner to correspond with the 3D video content 1102. Thedecimated video content is input into a video content copier 1116 thattakes the reformatted size video content and repeats and offsets so thatthe copier 1116 converts the 2D video content 1104 and 1106 into 3Dvideo content 1118. The format of the converted 2D video content 1118output from the copier 1116 is in one of the vertical, horizontal orquincunx format that corresponds to the format of the compressed 3Dvideo content 1102 determined by the detector 1114. The converted 2Dvideo content 1118 is input into a compressor 1120 so that it iscompressed to be the same as compressed 3D video content 1102. Thedecimator 1112 and the copier 1114 are collectively known as aconverter.

A bit stream splicer 1122 is provided. The compressed 3D video content1102 and the compressed converted 2D video content 1118 are input intothe splicer 1122. The splicer combines the two inputs into a combined 3Dvideo content 1124 that is provided from the cable head end 110 to eachof the subscribers 150 a-n. The splicer inserts the converted 2D videocontent into selected or designated locations within the 3D videocontent. Each of the subscribers that have the 3D ready TV 122 candecode the combined video content and display that content in 3D to anend user. It is understood that the video conversion device 1100 canprovide combined 3D video content 1124 when uncompressed video contentis provided using the principles described in connection with the videoconversion device 900.

FIG. 12 is a flow diagram that illustrates the method that is performedby the video conversion device 1100 described in FIG. 11 and thatcombines a 2D video content stream with a 3D video content stream sothat the two video content streams can be displayed on a 3D displaydevice such as 3D TV. The method begins by providing 1202 a compressed3D video content 1102. The compressed 3D video content can be a 3D TVaudio/video bit stream that is configured in one of a number of knownformats, e.g. vertical format, horizontal format or quincunx format. Thedetector 1114 parses 1204 the 3D video content 1102 to determine the 3Dformat of the content. The detector determines if the content 1102 isformatted as vertical 3D content, horizontal 3D content or quincunxvideo content. In an embodiment, the 3D TV audio/video bit stream is TVprogramming that has been created using 3D technology.

The method also includes providing 1206 2D video content 1104, 1106. The2D video content is conventional programming and can include a 2Daudio/video bit stream such as a commercial that will be inserted intothe 3D audio/video bit stream. The 2D video content that is to be usedby the video conversion device 1100 can be either uncompressed 2D videocontent 1104 or compressed 2D video content 1106. In the case of thecompressed 2D video content 1106, the video decoder decompresses thecontent.

The 2D video content 1104, 1106 and the 3D video content format that isdetermined by detector 1114 are provided to the decimator 1112. Themethod continues by decimating 1208 the 2D video content 1104, 1106 as apart of the process of converting the 2D video content into a formatthat is determined by the detector 1114 and that can be displayed by 3Ddevice such as a 3D TV. The decimated 2D video content is input into thevideo content copier 1116. The decimated 2D video content is then copied1210. The combination of decimating 1208 and copying 1210 takes the 2Dvideo content and formats the content into a vertical, horizontal orquincunx pattern for one of the left eye or the right eye and thenrepeated into the other vertical, horizontal or quincunx pattern for theother of the left or right eye. The 3D format chosen to create theconverted 2D video content 1118 is the determined by detector 1114.Thus, the decimating and copying creates converted 2D video content 1118where the converted 2D video content is in a format that can bedisplayed with the 3D video content 1102 by a 3D device such as a 3D TV.

The converted 2D video content 1118 is compressed 1212 by compressor sothat the converted 2D video content is compressed in the same format asthe compressed 3D video content. The compressed 3D video content 1102and the converted 2D video content are input into the bit stream splicer1120. The method 1200 continues by splicing 1214 the 3D video content1102 and the converted 2D video content 1118 together to form combined3D video content 1124. The combined 3D video content is output 1216 sothat it can be displayed by a 3D device. In an embodiment, the 2D videocontent 1104, 1106 is a commercial that will be inserted into a 3D TVprogramming, e.g. 3D movie to be displayed on a 3D TV. The converted 2Dvideo content 1118 is spliced into the 3D video content at designatedpoints within the video steam so that the combined 3D video can beoutput and easily displayed by the 3D TV. It is understood that themethod described in connection with FIG. 12 that uses compressed 3Dvideo content can apply to uncompressed 3D video content using theprinciples described in connection with the method described in FIG. 10.

FIG. 13 is a block diagram of a video conversion device 1300. Asunderstood, the video conversion device 1300 can be a part of the cablehead end 110 or collocated with subscriber 150 a-n. In the embodimentshown, a compressed 3D video stream 1302 is provided. The 3D videostream 1102 can be any of the described vertical format, horizontalformat or quincunx format. Additional 3D video content streams can alsobe provided. The additional 3D video content can be either uncompressed3D video content 1304 or compressed 2D video content 1306. The 3D videocontent 1302, 1304, 1306 are received by the device 1300 by atransceiver. A 3D video decoder 1308 is provided that will decode thecompressed 3D video content 1306 so that decompressed video content 1310is outputted.

The decompressed 3D video content 1310 and the uncompressed 3D videocontent 1304 are input into a 3D video converter 1112. The 3D videoconverter takes the inputted 3D video content 1304, 1306 and changes theformat of the 3D format so that the 3D video content 1304, 1306 can beconverted into the type of 3D video content provided by 3D audio/videobit stream 1302. To determine the format of the 3D video content 1302,the device 1300 includes a detector 1314. The detector 1314 parses the3D video bit stream 1302 and determines if the bit stream is formattedas vertical 3D format, horizontal 3D format or quincunx 3D format. Theresult of the detector 1314 is input to the converter 1312 so that itwill convert the 3D video content 1304, 1306 in the appropriate mannerto correspond with the 3D video content 1302. The converter 1312 takesthe components of the 3D video content 1304, 1306 to form a decimatedvideo content 1316 that can be converted into another 3D format. Thedecimated video content 1316 is input into a video content copier 1318that takes the reformatted size video content and repeats and offsets sothat the copier 1318 converts the 3D video content 1304 and 1306 intoconverted 3D video content 1320. The format of the converted 3D videocontent 1320 output from the copier 1118 is in one of the vertical,horizontal or quincunx format that corresponds to the format of thecompressed 3D video content 1302 determined by the detector 1314.

For example, the detector 1314 determines that the 3D video content 1302utilizes a horizontal 3D format. In the other hand, the 3D video content1304, 1306 is in a vertical 3D format. For the 3D video content 1304,1306 to be inserted into the 3D video content 1302, both 3D videostreams should use the same format. Thus, the converter 1312 manipulatesthe 3D video content 1304, 1306 such that all the components form bothhalves of the vertical format are retained and all those components aredecimated so that they can be copied by copier 1318 into the horizontal3D format.

The converted 3D video content 1320 is input into a compressor 1322 sothat it is compressed to be the same as compressed 3D video content1302.

A bit stream splicer 1324 is provided. The compressed 3D video content1302 and the compressed converted 2D video content are input into thesplicer 1324. The splicer combines the two inputs into a combined 3Dvideo content 1326 that is provided from the cable head end 110 to eachof the subscribers 150 a-n. Each of the subscribers that have the 3Dready TV 122 can decode the combined 3D video content and display thatcontent in 3D to an end user. It is understood that the video conversiondevice 1100 can provide combined 3D video content 1326 when uncompressed3D video content is provided using the principles described above.

FIG. 14 is a flow diagram that illustrates the method that is performedby the video conversion device described in FIG. 11 and that combines a3D video content stream of created using one 3D format with a 3D videocontent stream that uses another 3D format so that the two video contentstreams can be displayed on a 3D TV. The method begins by providing 1402a compressed 3D video content 1302. The compressed 3D video content canbe a 3D TV audio/video bit stream that is configured in one of a numberof known formats, e.g. vertical format, horizontal format or quincunxformat. The detector 1314 parses 1404 the 3D video content 1302 todetermine the 3D format of the content. The detector determines if thecontent 1302 is formatted as vertical 3D content, horizontal 3D contentor quincunx video content.

The method also includes providing 1406 additional 3D video content1304, 1306.

The additional 3D video content that is to be used by the videoconversion device 1300 can be either uncompressed 3D video content 1304or compressed 3D video content 1306. In the case of the compressed 3Dvideo content 1306, the video decoder decompresses the content.

The additional 3D video content 1304, 1306 and the 3D video content 1302format that is determined by detector 1314 are provided to the decimator1312. The method continues by decimating 1408 the 3D video content 1304,1306 as a part of the process of converting the 3D video content intothe 3D format that is determined by the detector 1314. The decimated 3Dvideo content 1316 is input into the video content copier 1318. Thedecimated 3D video content 1316 is then copied 1410. The combination ofdecimating 1408 and copying 1410 takes the additional 3D video content,formats the content into a vertical, horizontal or quincunx pattern forone of the left eye or the right eye and then repeated into the othervertical, horizontal or quincunx pattern for the other of the left orright eye. The 3D format chosen to convert the converted 3D videocontent 1320 is the determined by detector 1314. Thus, the decimatingand copying creates converted 3D video content 1320 where the converted3D video content is in a format that can be displayed with the 3D videocontent 1302 by a 3D device such as a 3D TV.

The converted 3D video content 1320 is compressed 1412 by compressor1322 so that the converted 3D video content is compressed in the samemanner as the compressed 3D video content 1302. The compressed 3D videocontent 1302 and the converted 3D video content 1320 are input into thebit stream splicer 1324. The method 1400 continues by splicing 1414 the3D video content 1302 and the converted 3D video content 1320 togetherto form combined 3D video content 1326. The combined 3D video content1326 is output 1416 so that it can be displayed by a 3D device. In anembodiment, the additional 3D video content 1304, 1306 is a commercialthat will be inserted into a 3D TV programming, e.g. 3D movie to bedisplayed on a 3D TV. The converted 3D video content 1320 is splicedinto the 3D video content at designated points within the video steam sothat the combined 3D video can be output and easily displayed by the 3DTV.

In the foregoing specification, specific embodiments of the presentinvention have been described. However, one of ordinary skill in the artappreciates that various modifications and changes can be made withoutdeparting from the scope of the present invention as set forth in theclaims below. Accordingly, the specification and figures are to beregarded in an illustrative rather than a restrictive sense, and allsuch modifications are intended to be included within the scope ofpresent invention. The benefits, advantages, solutions to problems, andany element(s) that may cause any benefit, advantage, or solution tooccur or become more pronounced are not to be construed as a critical,required, or essential features or elements of any or all the claims.The invention defined solely by the appended claims including anyamendments made during the pendency of this application and allequivalents of those claims as issued.

What is claimed is:
 1. A method comprising: receiving a firstthree-dimensional video content; determining, using a processor, athree-dimensional format of the first three-dimensional video content;converting a two-dimensional video content into a secondthree-dimensional video content based on the determinedthree-dimensional format, wherein converting the two-dimensional videocontent comprises decimating the two-dimensional video content; andsplicing the second three-dimensional video content into the firstthree-dimensional video content.
 2. The method of claim 1, wherein thethree-dimensional format of the first three-dimensional video contentcomprises at least one of vertical 3D format, horizontal 3D format, orquincunx 3D format.
 3. The method of claim 1, wherein the secondthree-dimensional video content is in the determined three-dimensionalformat.
 4. The method of claim 1, wherein converting the two dimensionalvideo content further comprises copying the decimated two-dimensionalvideo content.
 5. The method of claim 1, wherein splicing the secondthree-dimensional video content into the first three-dimensional videocontent comprises: identifying at least one location within the firstthree-dimensional video content; and splicing the secondthree-dimensional video content into the first three-dimensional videocontent at the at least one location within the first three-dimensionalvideo content.
 6. The method of claim 1, further comprising: receiving athird three-dimensional video content; generating a convertedthree-dimensional video content by converting the thirdthree-dimensional video content into the determined three-dimensionalformat of the first three-dimensional video content; and splicing theconverted three-dimensional video content into the firstthree-dimensional video content.
 7. The method of claim 6, whereingenerating the converted three-dimensional video content furthercomprises decimating the third three-dimensional video content.
 8. Asystem comprising: a memory; and a processor communicably coupled to thememory, the processor to: receive a first three-dimensional videocontent; determine a three-dimensional format of the firstthree-dimensional video content; convert a two-dimensional video contentinto a second three-dimensional video content based on the determinedthree-dimensional format, wherein to convert the two-dimensional videocontent, the processor is to decimate the two-dimensional video content;and splice the second three-dimensional video content into the firstthree-dimensional video content.
 9. The system of claim 8, wherein thethree-dimensional format of the first three-dimensional video contentcomprises at least one of vertical 3D format, horizontal 3D format, orquincunx 3D format.
 10. The system of claim 8, wherein the secondthree-dimensional video content is in the determined three-dimensionalformat.
 11. The system of claim 8, wherein to convert the twodimensional video content, the processor is further to copy thedecimated two-dimensional video content.
 12. The system of claim 8,wherein to splice the second three-dimensional video content into thefirst three-dimensional video content, the processor is further to:identify at least one location within the first three-dimensional videocontent; and splice the second three-dimensional video content into thefirst three-dimensional video content at the at least one locationwithin the first three-dimensional video content.
 13. The system ofclaim 8, wherein the processor is further to: receive a thirdthree-dimensional video content; generate a converted three-dimensionalvideo content by converting the third three-dimensional video contentinto the determined three-dimensional format of the firstthree-dimensional video content; and splice the convertedthree-dimensional video content into the first three-dimensional videocontent.
 14. The system of claim 13, wherein to generate the convertedthree-dimensional video content, the processor is further to decimatethe third three-dimensional video content.
 15. A non-transitorymachine-readable storage medium storing instructions which, whenexecuted, cause a processor to: receive a first three-dimensional videocontent; determine a three-dimensional format of the firstthree-dimensional video content; convert a two-dimensional video contentinto a second three-dimensional video content based on the determinedthree-dimensional format, wherein to convert the two-dimensional videocontent, the processor is to decimate the two-dimensional video content;and splice, using the processor, the second three-dimensional videocontent into the first three-dimensional video content.
 16. Thenon-transitory machine-readable storage medium of claim 15, wherein thethree-dimensional format of the first three-dimensional video contentcomprises at least one of vertical 3D format, horizontal 3D format, orquincunx 3D format.
 17. The non-transitory machine-readable storagemedium of claim 15, wherein the second three-dimensional video contentis in the determined three-dimensional format.
 18. The non-transitorymachine-readable storage medium of claim 15, wherein to convert the twodimensional video content, the processor is further to copy thedecimated two-dimensional video content.
 19. The non-transitorymachine-readable storage medium of claim 15, wherein to splice thesecond three-dimensional video content into the first three-dimensionalvideo content, the processor is further to: identify at least onelocation within the first three-dimensional video content; and splicethe second three-dimensional video content into the firstthree-dimensional video content at the at least one location within thefirst three-dimensional video content.
 20. The non-transitorymachine-readable storage medium of claim 15, wherein the processor isfurther to: receive a third three-dimensional video content; generate aconverted three-dimensional video content by converting the thirdthree-dimensional video content into the determined three-dimensionalformat of the first three-dimensional video content; and splice theconverted three-dimensional video content into the firstthree-dimensional video content.